Alzheimer&#39;s cognitive enabler

ABSTRACT

A computing device that enables user interaction when the user is in a mentally debilitating state includes a memory configured to store electroencephalogram (EEG) waveform signals. The EEG waveform signals are generated by associated recognition data. Response data is generated based on the associated recognition data and stored in memory. An input component is configured to receive an EEG waveform signal from a user. A processor is configured to compare the received EEG waveform signal with the stored EEG waveform signals to determine if the received EEG waveform signal matches a stored EEG waveform signal. An output component is configured to automatically output the response data generated by the associated recognition data based on the determination from the processor.

BACKGROUND OF THE INVENTION

1. Field of the Invention

Embodiments of the present invention relate to apparatus, systems andmethods for improving the quality of life of an individual sufferingfrom a debilitating disease as well as members of interest affected bythe sufferer's diminished capacity.

2. Description of the Related Art

Debilitating diseases which affect a person's mental capacity areespecially difficult to endure, both for the individual suffering fromthe disease as well as family members, friends and caregivers who mustcare for the individual. One form of a mentally debilitating disease isdementia. Dementia is a brain disorder that seriously affects a person'sability to carry out daily activities. The most common form of dementiaamong older people is Alzheimer's disease, which initially involves theparts of the brain that control thought, memory, and language. In itsearly stages, memory loss, shown as a difficulty to remember recentlylearned facts, is the most common symptom, although it is ofteninitially misdiagnosed as age-related memory-loss or stress. Latersymptoms include confusion, anger, mood swings, language breakdown,long-term memory loss, and the general withdrawal of the sufferer as hisor her senses decline. Each individual experiences the symptoms ofAlzheimer's disease in unique ways. The duration of the disease isbetween 5 and 20 years.

Currently, there is no cure for Alzheimer's disease. Also, there are noeffective ways for an Alzheimer's disease sufferer to effectivelyinteract with family and friends at the various stages of the disease.

Therefore, a need exists for an apparatus, system and method that allowsan Alzheimer's disease suffer to effectively interact with family,friends, caregivers, etc. at the various stages of the disease.

SUMMARY OF THE DISCLOSURE

Accordingly, an Alzheimer's cognitive enabler is disclosed that allowsan Alzheimer's disease suffer to effectively interact with family,friends, caregivers, etc. at the various stages of the disease.

According to one embodiment of the present invention, a computing devicethat enables user interaction when the user is in a mentallydebilitating state includes a memory configured to storeelectroencephalogram (EEG) waveform signals. The EEG waveform signalsare generated by associated recognition data. Response data is generatedbased on the associated recognition data and stored in memory. An inputcomponent is configured to receive an EEG waveform signal from a user. Aprocessor is configured to compare the received EEG waveform signal withthe stored EEG waveform signals to determine if the received EEGwaveform signal matches a stored EEG waveform signal. An outputcomponent is configured to automatically output the response datagenerated by the associated recognition data based on the determinationfrom the processor.

According to another embodiment of the present invention, a computersystem that enables user interaction when the user is in a mentallydebilitating state includes a computing device and a server computer.The computing device includes a memory, an input component, a processorand an output component. The memory is configured to store EEG waveformsignals. The EEG waveform signals are generated by associatedrecognition data. Response data is generated based on the associatedrecognition data and stored in memory. The input component is configuredto receive an EEG waveform signal from a user. The processor isconfigured to compare the received EEG waveform signal with the storedEEG waveform signals to determine if the received EEG waveform signalmatches a stored EEG waveform signal and the output component isconfigured to automatically output the response data generated by theassociated recognition data based on the determination from theprocessor. The server computer is configured to update EEG waveformsignals, associated recognition data and response data stored in thememory of the computing device.

According to a further embodiment of the present invention, a method forenabling user interaction when the user is in a mentally debilitatingstate includes storing electroencephalogram (EEG) waveform signals,whereby the EEG waveform signals are generated by associated recognitiondata. The method also includes the steps of storing response datagenerated based on the associated recognition data and receiving an EEGwaveform signal from a user. The method further includes the steps ofcomparing the received EEG waveform signal with the stored EEG waveformsignals and determining that the received EEG waveform signal matches astored EEG waveform signal. The method also includes the step ofautomatically outputting the response data generated by the associatedrecognition data based on the determining step.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features, aspects and advantages of the presentinvention will become better understood with regard to the followingdescription, appended claims and accompanying drawings where:

FIG. 1 illustrates a user with an embodiment of the Alzheimer'sCognitive Enabler (ACE) device of the present invention;

FIG. 2 illustrates an operating environment in which the ACE device,system and method of the present invention may operate; and

FIG. 3 is a flowchart depicting steps performed within the ACE device inaccordance with one embodiment of the present invention.

DETAILED DESCRIPTION

Unless otherwise specified, “a” or “an” means “one or more.”

Recent advancements in non-invasive electroencephalogram (EEG) waveformmonitoring for the gaming industry have enabled a significant array ofEEG waveform signals to be associated with ideational content. Inaddition, recent advancements in image and voice recognitiontechnologies have enabled these technologies to be used easily withpersonal computers. These technologies, however, have been limited tobeing practiced in their on particular industry and have not been linkedtogether to assist individuals suffering from Alzheimer's disease. Ingeneral, an Alzheimer's disease patient is mentally capable of more thanthey can articulate or express. According to an embodiment of thepresent invention, an Alzheimer's cognitive enabler (ACE) allows theAlzheimer's disease patient to draw upon his or her less-affectedcognitive waveforms to trigger recognition and conversation functionsthat are blocked by beta amyloid plaque in the brain, but can be madeavailable on the ACE. In other words, the ACE may be equated to orconceptualized as a “cognitive wheelchair” providing mental assistanceas compared to physical assistance provided by a conventionalwheelchair.

Consider, for example, ACE device 100 being carried by user 110 (i.e.,an Alzheimer's patient) in FIG. 1. In this exemplary embodimentillustrated in FIG. 1, the ACE device 100 has access to input devicessuch as an EEG device 150, video camera 121, microphone 124, and inputdevice 122 (e.g., a keyboard, a hand-writing recognition device, etc.).The ACE device 100 also has access to a visual display device 132 and aspeaker output device 134. In some embodiments of the present invention,the input and output devices may be integrated together with the ACEdevice 100 into a single device, while in alternative embodiments theACE device 100 may be a separate device that has the ability to acceptinput from and provide output to (e.g., via physical or wirelessconnections) any of a variety of devices which may be accessible (e.g.,carried by the user or located nearby in the environment). The ACEdevice 100 further includes a processor 160 for processing informationstored in its memory 165 as discussed in greater detail below.

The invention is further illustrated by, though in no way limited to,the following particular embodiments and examples. In the exampleillustrated in FIG. 1, a variety of situations are illustrated for whichuser 110 may wish to store information that can be later used to assistthe user 110 to interact with persons 170. According to one embodimentof the present invention, the ACE device 100 is prescribed for user 110at the user's first sign of cognitive decline. During this stillrelatively healthy stage, the Alzheimer's patient, family member(s)and/or caregivers would load the ACE device 100 with the patient'ssalient images, voices data, memories, etc. and associated EEGwaveforms. Via artificial intelligence technology, however, it is notcritical that every bit of data has an associated EEG waveform. Forexample, there may be an EEG waveform associated with the image of apatient's son. However, there need not be an EEG waveform associatedwith an image of the son together with the patient. The artificialintelligence program running the ACE device 100 uses relational databasetechnology to bring together related images after an index image is EEGtriggered. More generally, the ACE device 100 is configured to conduct anormal conversation with a person based on stored data and advancedartificial intelligence-based chatbot software upon an EEG waveformassociated with just recognition of the person. In general, any EEGwaveform will trigger some conversational capability out of the ACEdevice 100, with such conversational capability being as close to themotivations that gave rise to the EEG waveform as the storedassociations permit. While wearing EEG device 150, the Alzheimer'spatient is able to train the ACE device 100 to react as he or she wouldin given situations when interacting with others. Thereafter, once thedisease has progressed, the ACE device 100 can be used to interact withothers on behalf of the Alzheimer's patient using images and soundrecognition routines, conversational software and patient-specificsettings previously stored and continuously updated as discussed ingreater detail below.

For example, upon encountering person 170 for the first time, the user110 may wish to store a variety of information about the person forlater recollection. In particular, the user 110 can use the video camera121 and microphone 124 to capture video and audio recordings of theencounter. The user 110 can also use the video camera 121 to captureother current information about the environment which may assist inlater recollection about the encounter, such as a video image of thelocation in which the encounter occurred. In addition, the user 110 canuse the microphone 124 to record dictated information about the person170, such as the person's name, address, e-mail address, phone number,etc. The ACE device 100 can then store this dictated information as anaudio recording, or can instead perform voice recognition on thedictation in order to produce a textual version of the information.Alternately, the user 110 can provide some, or all of the informationabout the person to the ACE device 100 directly as text via text inputdevice 121. In other embodiments, the user 110 can provide informationto the ACE device 100 via any other available input means, such astransmitted information from a portable device (not shown) that theperson might be carrying (e.g., another ACE device). After receiving andprocessing the various information about the encounter with the person170, the ACE device 100 associates the various information with thereceived EEG waveform signal from the EEG device 150.

According to one embodiment of the present invention, the ACE device 100is configured such that an Alzheimer's patient who sees person 170again, but fails to recognize him, could automatically trigger anappropriate greeting for person 170 based on the EEG waveform generatedwhen the Alzheimer's patient's see that person again but is unable torecognize him.

The ACE device 100 may be in the form of a general-purpose body-mountedwearable computer worn by user 110. Many wearable computers travel withthe user, such as being strapped or attached to a user's body orclothing or being mounted in a holster. The wearable computer has avariety of user-worn user input devices including the microphone 124, ahand-held flat panel display with character recognition capabilities,and various other user input devices 222. Similarly, the computer has avariety of user-worn output devices that include the hand-held flatpanel display, an earpiece speaker, an eyeglass-mounted display, etc. Inaddition to the various user-worn user input devices, the computer canalso receive information from various user sensor input devices and fromenvironment sensor input devices, including the video camera 121. TheACE device 100 can receive and process the various input information andcan present information to the user 110 on the various output devices.Thus, as the user 110 moves about in various environments, the ACEdevice 100 receives various input information from the input devicesthat can be stored.

The general-purpose body-mounted wearable computer may include a touchscreen feature (which may approximate the size of a human head, butcould be any size, for example) that enables the ACE device 100 torespond to tactile as well as audio and video inputs. For example, ifthe Alzheimer's patient was in a late stage of the disease, thepatient's omnipresent, naturally moving image on the touch screen couldbe kissed, and the programming features of the ACE device 100 wouldrecognize that input and respond in the Alzheimer patient's voice, witha reply such as “THANK YOU FOR THE KISS GRANDSON.”

Those skilled in the art will appreciate that specialized versions ofthe body-mounted computer can be created for a variety of purposes.Those skilled in the art will also appreciate that a variety of suchphysiological conditions can be monitored, and that other specializedversions of the device can similarly be implemented.

System Environment

Referring to FIG. 2, an ACE system and method of the present inventionoperates primarily in a computer network environment. In thisembodiment, the ACE system 20 includes a program system administrationsite 10 which includes server computer 12 and a system database 14 and anumber of workstations 18 that communicate with the server computer 12.The workstations 18 may be used by patients/caregivers 18 a, familymembers 18 b or friends 18 c or any other system participant 18 d.According to an embodiment of the present invention, the workstation 18may be a stand alone personal computer (PC) based system with wirelessinternet connectivity, and Smart Phones with Wi-Fi connectivity to anoff-site server, the same as the ACE device 100. The off-site server mayprovide software upgrades, act as a repository for certain databasefunctions and provide diagnostic functions. For example, thewireless-linked feature of the ACE device 100 and the ACE system 20helps to ensure that no data is lost in the event of a failure, theft,breakage or loss of the ACE device 100. At user-settable periods alldata from the ACE device 100 is automatically uploaded to servercomputer 12 and then to system database 14 for safe storage. This storeddata can be readily downloaded into a replacement ACE device. Thepersonal computer typically will require a video monitor, sound andvideo cards. Alternatively, the workstation 18 may be any device capableof interacting with a computer network, including such devices aspersonal digital assistance (PDA) and cellular phones.

Additional system requirements include a PC compatible video camera, PCcompatible directional microphone, speakers, and a Blue Tooth commercialEEG headset. In the caregiver/institutional setting, a tablet PC, andvoice activated microphones may be required in addition to the above.Embodiments of the present invention also may require onsite trainingand a patient support facility 24 in some cases or the patient mayrequire assistance in utilizing the invention, in both instances the ACEsystem 20 is amenable to additional users assisting the patient inproviding the input or in training the patient in utilizing thesupplemental system input devices. Resident on the sever computer 12 ofthe ACE system 20 is an Alzheimer's disease recognition program 16.Also, with the wireless-linked feature of the ACE device 100 and ACEsystem 20, responsiveness of the ACE device 100 to be continuallyimproved via new software downloaded from server computer 12. At theserver computer 12, software will analyze the ACE patterns ofinteraction the are uploaded each day to tune the ACE device's 100program to better match the Alzheimer's patient's healthy pattern ofconversation. According to one embodiment of the present invention,server 12 has installed therein, newer versions of conversationalsoftware that are more sophisticated in replicating normalconversational patterns. Such software is configured to review savedconversations between the patient and family to identify errors andadjust conversational parameters. This is analogous to how “auto-tune”software works with digital music, in that a person's voice can beanalyzed for being off-tune and corrected.

System Training and Data Base Elements

According to one preferred embodiment of the present invention, the ACEdevice 100 and ACE system 20 are trained via patient interaction in eachof the following instances: recording the patient's voice, obtainingvarying minutes of digital video of the patient's facial expressions(speaking, laughing, and joy, sadness) to obtain a viseme database. Asused throughout this specification, a viseme is defined as a unit ofspeech in the visual domain; how ones face forms words and expressions.The ACE device 100 and ACE system 20 build a lexicon of patient'svisemes from video taping the patient. In the case where the patientcannot participate, the lexicon is built synthetically. In the syntheticprocess, the patient's face is photographed in high definition, forexample, and donor visemes are digitally overlaid onto the photographedface of the patient and the result is akin to live animation.

According to one embodiment of the present invention, videotaping can beperformed by trained staff, a caregiver, etc. The patient may alsoconstruct, or be assisted in constructing a database of family membersand friends (Family/Friends) with whom the patient would wish tointeract. The database may also include the contact information forcaregivers and health care providers. According to the operation of thepresent invention, voice samples of these individuals may be collectedfrom Wi-Fi capable cell phone interactions, as well as prearranged voicerecording conducted by training staff. Afterwards, the patient mayconstruct or be aided in constructing, or have constructed by thetraining staff, a database of responses for their phone (cellular andlandline) and PC systems, as well as establishing the pre-sets for whenthe system responds for them.

According to an exemplary embodiment of the present invention, baselinevoice samples of the patient may be used for Alzheimer analysis. Thepatient may be instructed by a staff member in the training and use ofthe EEG device 150. As stated previously, the EEG device 150 serves asan auxiliary data input tool and data collection device for the ACEdevice 100 and ACE system 20 with the EEG signals serving in place ofthe PC's mouse, acting as a drawing and pointing/selection agent on thescreen, and one capable of dragging and dropping screen based objects.According to an alternative embodiment of the present invention, if theEEG signals are confused, or unrecognized, the software is configured todefault to running as if the appropriate EEG signal was triggered. Forexample, if “daughter” has a specific EEG, signal but it is notrecognized, it will be possible for “daughter” to specify that it is thedaughter visiting the patient, and then the ACE device 100 will converseas if the EEG signal for “daughter” had been triggered. Familiarity withthe EEG device 150 will also assist the patient in accessing the deviceand system as the patient's health declines. Baseline EEG samplesobtained from patient use may be uploaded to the server 12 and the datamay be then analyzed. The patient may be trained to use the voicerecognition software as an auxiliary data entry tool. This will allowthe patient to more readily enter his or her autobiographical memories,and to use the PC more fully in conjunction with the EEG device 150.Voice samples from the usage may be utilized for voice synthesis as wellas diagnostic analysis.

Profiles

According to one preferred implementation of the present invention, thedata collected through phone conversations and interviews with thepatient and the patient's Family/Friends may be utilized to assist inconstructing affirmative conversations for the ACE device 100 and ACEsystem 20 to deploy. In the instance that the patient is sufficientlyincapacitated and unable to participate in the interview process, in apreferred implementation of the present invention, staff psychologistsmay conduct interviews with Family/Friends, review personal material andconstruct a patient autobiographical inventory that will serve as thebasis for constructing a conversational database and theautobiographical database stored either in the ACE device 100 or storedremotely on the ACE system 20.

According to the operation of the ACE device 100 and the ACE system 20,if a user 110 is unable to recognize a person initiating a conversation,the EEG waveform signal generated from the EEC device 150 is used toretrieve the correct responses. According to an alternative operation ofthe ACE device 100 and ACE system 20, voice and face recognitionsoftware is used to identify the initiator of a conversation and thenthe ACE device 100 and ACE system 20 supplies a correct response setbased on the recognition of the initiator of the conversation. In thepreferred implementation of the present invention, the response isprofiled based upon the historical psychodynamics between thatindividual and the patient. The ACE device 100 and ACE system include aprofiling methodology which is a psychological framework employed tomaximize the therapeutic investment of energy into the suspense ofdisbelief experienced by the patient's Friend/Family in interacting witha patient avatar. According to the present invention, a patient avataris defined as an audio construct of the patient, one that will have thepatient's face, facial expression and voice. In the instance that thepatient was an early participant of the system and partook in the systemtraining, the patient avatar will appear on the monitor speaking in thepatient's own voice, and to a very large degree, with the patients' ownfacial expressions. If the patient was unable to participate, the voicewill be gender appropriate and pitch and tone balanced. According to anexemplary embodiment of the present invention, the facial expression maybe human and warm and the face will be that of the patient.

According to an alternative embodiment of the present invention, the ACEdevice 100 and ACE system 20 may include an emotion software engine thatis based upon actual digitally sampled emotions from an Alzheimer'spatient. According to this implementation of the present invention, theACE device 100 and ACE system 20 are configured to portray realisticemotions of the Alzheimer's patient, triggered by EEG waveform signalsand/or program-analyzed semantic cues in an conversational softwareengine.

According to one embodiment of the present invention, the conversationaldatabase generates an appropriate conversational segment in response toa unique speaker from the information stored in the system database 14or in the memory of the ACE device 100 and then further processed. Anexample conversation is provided below:

SARAH: HI NANA, HOW ARE YOU?

NANA: I'M DOING SO-SO TODAY PRECIOUS, HOW IS YOUR LITTLE JO-JO?

Sarah, the grand-daughter, is recognized by the ACE device 100 or theACE system 20, either by the associated EEG waveform, voice recognitionsoftware or face recognition software, the conversation generation thenlooks up Sarah, recognize her grandmother's pet name for her and thatshe has a pet named Jo-jo.

System Inputs

As part of the ACE device 100 and ACE system 20, inputs according to anembodiment of the present invention, including videotaping of a patientin scripted conversation conducted by training staff. According to onepreferred implementation of the present invention, this may be held overmultiple sessions of 15 minute duration totaling 60 minutes inaggregate, for example. The sessions are designed to capture the patientin a variety of emotional responses and facial patterns. Thetrainer/technician performing the video taping in addition to followingthe script may be trained in how to provoke the various emotiveresponses desired in order to capture a variety of facial expression ofthe patient. The resulting video is then processed into the visemedatabase for the patient avatar as discussed above. For example, highquality head shots of the patient's designated Family/Friends may betaken by the training staff and input into the ACE device 100 and ACEsystem 20 for the facial recognition component. The training staff mayalso sample Family/Friend vocal recordings for input into the voicerecognition component. In the event that the patient is of diminishedcapacity and cannot withstand the rigors of the interview process, thetrainer may take high definition images of the patient's face. Visemesmay then be constructed synthetically from the images. The process isone of overlaying the patients face over a “digital donor”, one carriesout the process of mapping say, trainer Mary's visemes, removing Mary'scharacteristic facial features leaving behind a dynamic template, andthen mapping the patient's facial features onto the template. This maybe a one time process, completed on site by the training staff.

System Output

As part of the ACE device 100 and ACE system 20 outputs according to anembodiment of the present invention, text, audio-visual, or audioresponses through the patient's phone system (land as well as cellular)and PC/PDA/Smartphone either at the patient's request or at apredetermined setting in response to the diagnostic data gathered fromthe patient may be output. Video may be processed and synchronized withthe patient's visemes to produce a patient avatar. According to onepreferred implementation of the present invention, the processing may beconducted by training staff onsite. The ACE device 100 and ACE system20, when prompted by the initiator, may then cue the conversationaldatabase load either in the system database 14 or locally in memory ofthe ACE device 100 for the initiator and prepare to integrate the speechsynthesis engine with the patient avatar in response to the initiatorsspoken word.

System Diagnostics

According to one preferred embodiment of the present invention, voicedata obtained from voice control of the PC and from cellularconversations may be analyzed for early onset of the Alzheimer's usingcurrently established diagnostic benchmarks developed for voicerecognition technology and the indicia of Alzheimer's disease. This dataset may be compared against baseline voice data collected at thepatient's initial use of the system. EEG waveform data collected fromthe patient may be analyzed using currently established protocols forthe prediction of or indicia of Alzheimer's disease. Through these twoprocesses a reasonable degree of statistical likelihood exists in beingable to understand the degree of incapacity of the patient at a giventime and whether to invoke the patient's choices in terms of respondingto phone calls or PC communications, or in calling for caregivers,health providers or family members.

System and Program Model

According to a further preferred embodiment of the present invention,ACE system 20 is a system platform that is designed to assist a patientdiagnosed in the pre-onset stages of Alzheimer's disease through thelater stages of the disease. In the pre-onset stage, the preferred modelenvisions a patient's interacting directly with the ACE device 100 andACE system 20, providing inputs both for system training, patientdiagnosis and patient memory storage. As the patient becomes infirmed,or feels unable to complete or attend to specific communication basedtasks, the device and system provide responses for the patient. If thepatient becomes institutionalized or requires a caregiver and reaches astage of diminished conversational capacity, the ACE device 100 and ACEsystem 20 are configured to recognize a vocal prompt and or the face ofa member from the Family/Friend indexed in the database 14 or localmemory, which will initialize the device and system and will commenceconversation with the indexed individual.

In the pre-onset stage of Alzheimer's disease, the patient interactswith the device and system through a number of dimensions. Phoneconversations provide profile data for the Family/Frienddatabase-namely, the individuals within the database, voice samples,frequency and duration of interaction; cellular phone data istransmitted via Wi-Fi to the server 12 for storage and analysis. PCbased activities may be gradually controlled by supplemental devices,viz., the patient's oral commands (voice recognition) and through EEGwaveform based commands. Data collected from the device and system maybe transmitted to the server 12 for diagnostic analysis and for use inthe patient avatar. If the patient feels fatigued, or if the EEGwaveform based diagnostics advise the patient or the patient's caregiverthat the patient is entering a deficit, the device and system may beengaged by default or by the patient's choice to intervene on any or allcommunication channels available to the patient. If the perceiveddeficit reaches a predetermined threshold, the device and system isconfigured to alert caregivers, healthcare providers, and family membersand friends as desired.

In the intermediate stage of Alzheimer's disease, the patient has somecapacity for conversation, or may easily feel fatigue. According to apreferred implementation of the present invention, the patient may wearand may interact with the ACE device and ACE system through the EEGdevice 150 and may guide the conversation with Family/Friends, selectingconversational elements from the conversational database or elementsfrom his or her autobiographical database via a tablet PC. In thisimplementation of the present invention, the patient may also turn thepatient avatar on or off. The pre-sets established will determinewhether the patient is in a state to make the determination.

When a patient is in a state of decline such that self sustainingconversation is either a burden to the patient or a mentalimpracticality, the ACE device and system is configured to intervenebetween the patient and family member, or the patient and the patient'sfriend. The patient is present, juxtaposed with a video monitor ofeither the ACE device or ACE system. In one preferred implementation ofthe present invention, one speaker at a time engages the patient, witheach speaker wearing a voice activated microphone. Upon speaking to thepatient, the device and system is activated via voice and facialrecognition using the software provided therein; the patient avatardisplays recognition, and enters into a conversation with the initiator.The patient avatar is configured to converse approximately as one wouldexpect an elderly family member: short answers, of durations 20 secondsor less, and for a total conversation length of no more than fiveminutes per family participant, for example.

According to an embodiment of the present invention, the conversationswith the same party normally will not repeat the same content during thenext conservation if (i) the original database is sufficiently robustand (ii) the conversation doesn't duplicate the content, for example.Even in the second instance, for example, there is no assurance that thecontent of the patient avatar's content would be the same. The contentof the conversation may be uploaded to a server, such as server 12 fordiagnostic analysis. Specific events referenced by the patient avatarmay be accessed by the Family/Friend by accessing the autobiographicaldatabase events referenced for that day.

Telemetry

According to an embodiment of the present invention, the ACE device andsystem are also configured to monitor patient pain and mood levels viaEEG waveform signals output as well as a standard set of outputs (e.g.,heartbeat, pulse rate, blood pressure, etc.). All data collected isavailable to the patient's health care providers and approvedsubscribers historically and in real-time via Wi-Fi (PC/Smartphone/PDA)or a remote server.

FIG. 3 is a flowchart depicting steps performed within the ACE device inaccordance with one embodiment of the present invention. The processbegins from a start state S400 and proceeds to process step S401,wherein EEG waveform signals are stored in memory. The EEG waveformsignals are generated by associated recognition data. At process stepS402, response data generated based on the associated recognition datais also stored in memory. After the information has been stored, atprocess step S403, an EEG waveform signal from a user is received. Afterreceiving the EEG waveform signal, the process proceeds to process stepS404 where the received EEG waveform signal is compared with the storedEEG waveform signals. After the comparison step, the process proceeds todecision step S405 where it is determined whether or not the receivedEEG waveform signal matches a stored EEG waveform signal. If thereceived EEG waveform signal matches one of the stored EEG waveformsignals, the process proceeds to process step S406 where the responsedata generated by the associated recognition data is automaticallyoutputted, otherwise, the process returns to process step S403.

Alzheimer's disease is characterized by a slow, gradual decline incognition which cause great sorrow and diminished quality of life to theAlzheimer's disease sufferer as well as his or her family. The ACEdevice, system and method can significantly ameliorate the diminishedquality of life.

Based on this description of exemplary embodiments, other embodimentswill be readily apparent to one of skill in the art. Thus, theseexemplary embodiments should be considered as limiting the scope, whichis defined according to the following claims.

1. A computing device that enables user interaction when the user is ina mentally debilitating state, comprising: a memory configured to storeelectroencephalogram (EEG) waveform signals, the EEG waveform signalsbeing generated by associated recognition data, wherein response data isgenerated based on the associated recognition data and stored in memory;an input component configured to receive an EEG waveform signal from auser; a processor configured to compare the received EEG waveform signalwith the stored EEG waveform signals to determine that the received EEGwaveform signal matches a stored EEG waveform signal; and an outputcomponent configured to automatically output the response data generatedby the associated recognition data based on the determination from theprocessor.
 2. The computing device according to claim 1, wherein theassociated recognition data include images data.
 3. The computing deviceaccording to claim 1, wherein the associated recognition data includesvoice data.
 4. The computing device according to claim 1, whereinresponse data includes voice data.
 5. A computing system that enablesuser interaction when the user is in a mentally debilitating state,comprising: a computing device, comprising: a memory configured to storeelectroencephalogram (EEG) waveform signals, the EEG waveform signalsbeing generated by associated recognition data, wherein response data isgenerated based on the associated recognition data and stored in memory;an input component configured to receive an EEG waveform signal from auser; a processor configured to compare the received EEG waveform signalwith the stored EEG waveform signals to determine that the received EEGwaveform signal matches a stored EEG waveform signal; and an outputcomponent configured to automatically output the response data generatedby the associated recognition data based on the determination from theprocessor; and a server computer configured to update EEG waveformsignals, associated recognition data and response data stored in thememory of the computing device.
 6. The computing system according toclaim 5, further comprising a system database.
 7. The computing systemaccording to claim 5, wherein the computing device is a wearablecomputer.
 8. The computing system according to claim 5, wherein theupdating is performed via wireless transmission.
 9. The computing systemaccording to claim 5, wherein the computing device includes a cellularphone.
 10. The computing system according to claim 5, wherein thecomputing device includes a personal computer.
 11. The computing systemaccording to claim 5, wherein the associated recognition data includeimages data.
 12. The computing system according to claim 5, wherein theassociated recognition data includes voice data.
 13. The computingsystem according to claim 5, wherein response data includes voice data.14. The computing system according to claim 6, wherein the systemdatabase includes a viseme database.
 15. The computing system accordingto claim 6, wherein the system database includes a conversationaldatabase.
 16. The computing system according to claim 6, wherein thesystem database includes an autographical database.
 17. A method forenabling user interaction when the user is in a mentally debilitatingstate, comprising: storing electroencephalogram (EEG) waveform signals,the EEG waveform signals being generated by associated recognition data,storing response data generated based on the associated recognitiondata; receiving an EEG waveform signal from a user; comparing thereceived EEG waveform signal with the stored EEG waveform signals;determining that the received EEG waveform signal matches a stored EEGwaveform signal; and automatically outputting the response datagenerated by the associated recognition data based on the determiningstep.
 18. The method according to claim 17, further comprising updatingthe stored EEG waveform signals, associated recognition data andresponse data.
 19. The method according to claim 18, wherein theupdating is performed via wireless transmission.
 20. The methodaccording to claim 17, further comprising creating a conversationaldatabase for the response data.
 21. The method according to claim 17,further comprising creating an autographical database.
 22. The methodaccording to claim 17, wherein the user suffers from Alzheimer'sdisease.